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Abstract 

Let N local decision makers in a sensor network communicate with their neighbors to reach a decision 
consensus. Communication is local, among neighboring sensors only, through noiseless or noisy links. 
We study the design of the network topology that optimizes the rate of convergence of the iterative 
decision consensus algorithm. We reformulate the topology design problem as a spectral graph design 
problem, namely, maximizing the eigenratio 7 of two eigenvalues of the graph Laplacian L, a matrix that 
is naturally associated with the interconnectivity pattern of the network. This reformulation avoids costly 
Monte Carlo simulations and leads to the class of non-bipartite Ramanujan graphs for which we find a 
lower bound on 7. For Ramanujan topologies and noiseless links, the local probability of error converges 
much faster to the overall global probability of error than for structured graphs, random graphs, or graphs 
exhibiting small-world characteristics. With noisy links, we determine the optimal number of iterations 
before calling a decision. Finally, we introduce a new class of random graphs that are easy to construct, 
can be designed with arbitrary number of sensors, and whose spectral and convergence properties make 
them practically equivalent to Ramanujan topologies. 
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I. Introduction 

The paper studies the problem of designing the topology of a graph network. As a motivational 
application we consider the problem of describing the connectivity graph of a sensor network, i.e., 
specifying with which sensors should each sensor in the network communicate. We will show that the 
topology of the network has a major impact on the convergence of distributed inference algorithms, 
namely, that these algorithms converge much faster for certain coimectivity patterns than for others, thus 
requiring much less intersensor communication and power expenditure. 

The literature on topology design for distributed detection is scarce. Usually, the underlying communi- 
cation graph is specified ab initio as a structured graph, e.g., parallel networks where sensors communicate 
with a fusion center, [1], [2], [3], [4], or serial networks where communication proceeds sequentially from 
a sensor to the next; for these and other similar architectures, see Varshney [5] or [6], [7]. These networks 
may not be practical; e.g., a parallel network depends on the integrity of the fusion center. 

We pubhshed preliminary results on topology design for distributed inference problems in [8], [9]. 
We restricted the class of topologies to structured graphs, random graphs obtained with the Erdos- 
Renyi construction, [10], [11], [12], see also [13], [14], or random constructions that exhibit small-world 
characteristics, see Watts-Strogatz [15], see also Kleinberg [16], [17]. We considered tradeoffs among 
these networks, their number of links M, and the number of bits b quantizing the state of the network 
at each sensor, under a global rate constraint, i.e., Mb = K, K fixed. We adopted as criterion the 
convergence of the average probability of error Pp, which required extensive simulation studies to find 
the desired network topology. Reference [18] designs Watts-Strogatz topologies in distributed consensus 
estimation problems, adopting as criterion the algebraic connectivity X2{L) of the graph. 

This paper designs good topologies for sensor networks, in particular, with respect to the rate of 
convergence of iterative consensus and distributed detection algorithms. We consider the two cases of 
noiseless and noisy network links. We assume that the total number M of communication links between 
sensors is fixed and that the graph weights are uniform across all network links. This paper shows 
that, for both the iterative average-consensus and the distributed detection problems, the topology design 
problem is equivalent to the problem of maximizing with respect to the network topology a certain graph 
spectral parameter 7. This parameter is the ratio of the algebraic connectivity of the graph over the largest 
eigenvalue \n{L) of the graph Laplacian L. The algebraic connectivity of a graph, terminology introduced 
by [19], is the second smallest eigenvalue \2{L) of its discrete Laplacian; see section II, the Appendix, 
and reference [20] for the definition of relevant spectral graph concepts. With this reinterpretation, we 
show that the class of Ramanujan graphs essentially provides the optimal network topologies, exhibiting 



3 



remarkable convergence properties, orders of magnitude faster than other structured or random small- 
world like networks. When the links are noisy, our analysis determines what is the optimal number 
of iterations to declare a decision. Finally, we present a new class of random regular graphs whose 
performance is very close to the performance of Ramanujan graphs. These graphs can be designed with 
arbitrary number of nodes, overcoming the limitation that the available constructions of Ramanujan graphs 
are restricted to networks whose number of sensors are limited to a sparse subset of the integers. 

We now summarize the paper. Section n and the Appendix recall basic concepts and results from 
algebra and spectral graph theory. Section m presents the optimal equal weights consensus algorithm 
and establishes its convergence rate in terms of a spectral parameter. Section IV defines formally the 
topology design problem, shows that Ramanujan graphs provide essentially the optimal topologies, and 
presents explicit algebraic constructions available in the literature for the Ramanujan graphs. Section V 
considers distributed inference and shows that the average-consensus algorithm with noiseless links 
achieves asymptotically the optimal detection performance — that of a parallel architecture with a fusion 
center. This section shows that with noisy communication links there is an optimal maximum number 
of iterations to declare a decision. Section VI demonstrates with several experiments the superiority of 
the Ramanujan designs over other different alternative topologies, including structured networks, Erdos- 
Renyi random graphs, and small-world type topologies. Section Vn presents the new class of random 
regular Ramanujan like graphs that are easy to design with arbitrary number of sensors and that exhibit 
convergence properties close to Ramanujan topologies. Finally, section Vm concludes the paper. 

II. Algebraic Preliminaries 

Graph Laplacian The topology of the sensor network is given by an undirected graph G = {V, E), 
with nodes Vn & V, n G Z = {1, N}, and edges the unordered pairs e = (vn,vi) G E, or, simply, e = 
{n, I), where v„ and vi are called the edge endpoints. The edge e = {n,l) & E whenever sensor Vn can 
communicate with vi, in which case the vertices Vn and vi are adjacent and we write vi. 

We assume that the cardinaUty E i?, \E\ = M and, when needed, label the edges by m, m = 
1, • • • , M. The terms sensor, node, and vertex are assumed to be equivalent in this paper. A loop is an 
edge whose endpoints are the same vertex. Multiple edges are edges with the same pair of endpoints. A 
graph is simple if it has no loops or multiple edges. A graph with loops or multiple edges is called a 
multigraph. A path is a sequence Vnaj - ■ ■ ,Vn^ such that ei = £ E, I = I, ■ ■ ■ ,m, and the 

, / = 0, • • • , m — 1, are all distinct. A graph is connected if there is a path from every sensor Vn to 
every other sensor vi, n,l = 1, . . . , N. In this paper we assume the graphs to be simple and connected. 
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unless otherwise stated. 

We can assign to a graph an AT x TV adjacency matrix A (where, we recall, N = \ V\,) defined by 



1 if (n, l)eE 

(1) 

otherwise 



The set of neighbors of node n is $7„ = {/ : (n, I) G E} and its degree, deg(n), is the number of its 
neighbors, i.e., the cardinaUty |iln|- A graph is k-regular if all vertices have the same degree k. 
The degree matrix, D is the A'^ x A'^ diagonal matrix D = diag [di^i ■ ■ ■ dN,N] defined by 

dn,n = deg(n) (2) 

The Laplacian L of the graph, [20], is the N x N matrix defined by 

L = D-A (3) 

Spectral properties of graphs. We consider spectral properties of connected regular graphs. Since the 
adjacency matrix A is symmetric, all its eigenvalues are real. Arrange the eigenvalues of the adjacency 
matrix A as, 

A; = Ai(A) > A2(^) > ... > AAr(^) > -A; (4) 

It can be shown that the multiplicity of the largest eigenvalue Xi{A) = k equals the number of connected 
components in the graph. Then, for a connected graph, the multiplicity of the eigenvalue A 1(^4) = is 
1, which explains the strict inequahty on the left in (4). Also, —A; is an eigenvalue of A iff the graph 
is bipartite (please refer to the Appendix for the definition of bipartite graphs.) Hence, for non-bipartite 
graphs, Ajv(^) > —k. In this paper, we focus on connected, non-bipartite graphs. 

The Laplacian is a symmetric, positive semi-definite matrix, and, consequently, all its eigenvalues are 
non-negative. It follows from (4) that the eigenvalues of the Laplacian satisfy 

= Ai(L)<A2(L)<...<Ajv(L) (5) 

The multiphcity of the zero eigenvalue of L equals the number of connected components in the graph, 
which explains the strict inequality on the left hand side of (5) for the case of connected graphs. For 
/c-regular graphs, the eigenvalues of A and L are directly related by 

Vn G X : Xn{L) = k- Xn{A) (6) 
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We write the eigendecomposition of the Laplacian L as 

L = UAU^ (7) 
= [ui • • • ujv] diag [Ai (L) • • • Ajv (L)] [ui • • • ujv]^ (8) 

where the u„, n = 1, • • • , A?^, are orthonormal and diag [• • • ] is a diagonal matrix. We note that, from 
the structure of L, each diagonal entry of D is the corresponding row sum of A, so the eigenvector ui 
corresponding to the zero eigenvalue Ai(L) is the (normalized) vector of one's 

ui = ^l = ^[l---l]^ (9) 

III. Average Consensus Algorithm 

In this Section, we present the consensus algorithm in Subsection IH-A, discuss the case of equal 
weights in Subsection IH-B, and estabUsh the convergence rate of the algorithm in Subsection IH-C. 

A. Consensus Algorithm Description 

We review briefly the consensus algorithm that computes in a distributed fashion the average of N 
quantities r„, n = 1, • • • ,N. Assume a sensor network with interconnectivity graph G = {V, E) defined 
by a neighborhood system $7 = : n G X}, and where is the set of neighbors of sensor n. Initially, 
sensors take measurements ri, . . . rjv. It is desired to compute their mean in a distributed fashion, 

N 



r = ^Y.^n (10) 



n=l 

i.e., by only local communication among neighbors. Define the state at iteration i = at sensor n by 

Xn{i = 0) = Tn, n = 1, • • • ,iV 

Iterative consensus is carried out according to the following hnear operation, [21], 

N 

Xn{i) = WnnXn{i " 1) + XI ^rilXl{i - 1) (11) 

where Wni is a weight associated with edge (n, I), if this edge exists. The weight Wni = 0, I, when 
there is no Unk associated with it, i.e., if (n, I) ^ E. The value Xn{i) stored at iteration i by sensor n is 
the state of Vn at i. The consensus (11) can be expressed in matrix form as 

Xi = Wxi-i (12) 
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where Xj is the AT x 1 vector of all current states and W = [Wni] is the matrix of all the weights. The 
updating (12) can be written in terms of the initial states as 

Xi = VF^xo (13) 
xo = [xi{0)---XNiO)f = [ri---rNf (14) 

Let the AT-dimensional vector 1 = [1 • • • 1]^. Convergence to consensus occurs if 

Vn : lim Xn{i) = r 

i— »oo 

lim Xj = X = r 1 (15) 

i— »oo 

11^ 

lim W = —- (16) 

i— ►oo N 

B. Link Weights 

The convergence speed of the iterative consensus depends on the choice of the hnk weights, Wni- In 
this paper, we consider only the case of equal weights, i.e., we assign an equal weight a to all network 
Hnks. / and L be the AT-dimensional identity matrix and the graph Laplacian. The weight matrix becomes 

W = I-aL (17) 

For a particular network topology, the value of a that maximizes the convergence speed is, [21], 

2 

= A2(L) + AAr(L) ^^^^ 

For proofs of these statements and other weight design techniques, the reader is referred to [21] and [18]. 

We now consider the eigendecomposition of the weight matrix W. From (17), with the optimal 
weight (18), using the eigendecomposition (8) of L, we have that 

W = [ui • • • un] diag [71 • • • jn] [ui • • • un]^ (19) 

N 

= 5Z > (20) 

n=l 

where: u„, n = 1, • • • , A^, are the orthonormal eigenvectors of L, and a fortiori of W; and diag [71 • • • 7iv] 
is the diagonal matrix of the eigenvalues 7„ of W. These eigenvalues are 

7„ = 1 - a*Xn(,L) (21) 

From the spectral properties of the Laplacian of a connected graph, and the choice of a*, the eigenvalues 



of W satisfy 

1 = 71 > 72 > ■ • • > TAT (22) 

Vn > 1 : |7„| < 72 < 1 (23) 

C. Consensus Algorithm: Convergence Rate 
We now study the convergence rate of the consensus algorithm. 

Result 1 For any connected graph G, the convergence rate of the consensus algorithm (12) or (13) is 

||xj -x|| < ||xo -x||72 (24) 

where x and xq are given in (15) and (13) and 

1-7 

72 = — ^ (25) 
1 + 7 



Proof: Represent the vector Xq in (14) in terms of the eigenvectors u„ of L 

N 



n=l 

where dn = Xq^u^. From the value of ui in (9) it follows that 

di = Vnt (28) 
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Replacing (20) and (27) in (13) and using (28) and the orthonormality of the eigenvectors of L (and W,) 
we obtain 



TV 



N 

1=1 n=l 

N 

= XI dnliViluJnn 

n,l=l 
N 



1=1 



N 



1=2 

N 



1=2 



where x is given in eqn (15). From these it follows that 



Xi - X 



N 



< 72 



N 



|xo-x|| 7^ 



(29) 



(30) 



(31) 
(32) 



To get (31), we used the bounds given by (23). To obtain (32) we used the fact that from (30), for i = 0, 
it follows that 



N 



1=2 



Xo - X 



(33) 



From (33) it follows that, to obtain the optimal convergence rate, 72 should be as small as possible. From 
the expression for 7^ in (21), and using the optimal choice for a in (18), we get successively 



72 = 1 - aX2{L) 

2A2(L) 



(34) 



= 1 - 



Xn{L) - A2(L) 
Xn{L) + X2{L) 
1-X2{L)/Xn{L) 
1 + X2{L)/Xn{L) 



(35) 
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Thus, the minimum value of 72 is attained when the ratio 



\2{L)/\m{L) 



(36) 



IS maximum, i.e.. 



max convergence rate ~ min72 ~ max 7 = max 



ML) 
Xn{L) 



(37) 



IV. Topology Design: Ramanujan Graphs 



In this section, we consider the problem of designing the topology of a sensor network that maxi- 
mizes the rate of convergence of the average consensus algorithm. Using the results of Section m, in 
Subsection IV-A, we reformulate the average consensus topology design as a spectral graph topology 
design problem by restating it in terms of the design of the topology of the network that maximizes an 
eigenratio of two eigenvalues of the graph Laplacian, namely, the graph parameter 7 given by (26). We 
then consider in Subsection IV-B the class of Ramanujan graphs and show in what sense they are good 
topologies. Finally, Subsection IV-C describes algebraic constructions of Ramanujan graphs available in 
the literature, see [22]. 

A. Topology Optimization 

We formulate the design of the topology of the sensor network for the average consensus algorithm as 
the optimization of the spectral eigenratio parameter 7, see (26). From our discussion in Section m, it 
follows that the topology that optimizes the convergence rate of the consensus algorithm can be restated 
as the following graph optimization problem: 



where Q denotes the set of all possible simple connected graphs with N vertices and M edges. 

We remark that (38) will be significant because we will be able to use spectral properties of graphs 
to propose a class of graphs — ^the Ramanujan graphs — for which we can present a lower bound on the 
spectral parameter 7. This avoids the lengthy and costly Monte Carlo simulations used to evaluate the 
performance of other topologies as done, for example, in our previous work, see [8], [9] or in [18]. 



max 7 = max 
Ge g Ge g 




(38) 
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B. Ramanujan Graphs 

In this section, we consider /c -regular graphs. Before introducing the class of Ramanujan graphs, we 
discuss several bounds on eigenvalues of graphs. We first state a well-known result from algebraic graph 
theory. 

Theorem 2 (Alon and Boppana [23], [22]) Let G = Gjv.fc be a fc-regular graph on N vertices. Denote 
by Ag(^), the absolute value of the largest eigenvalue (in absolute value) of the adjacency matrix A of 
the graph G, which is distinct from ±k; in other words, Xq{A) is the next to largest eigenvalue of A^. 
Then 

lim inf Ac ( A) > 2Vk-l (39) 

iV— >oo 

A second result, [23], also shows that, for an infinite family of A;-regular graphs Gm, m G {1, 2, • • • }, 
for which the number of nodes diverges as m becomes large, the algebraic coimectivity X2{L) of the 
graphs is asymptotically bounded by 

lim inf A2 (L) < k - 2Vk-l (40) 

N—*oo 

Note that (40) is a direct upperbound on the limiting behavior of X2{L) itself, while from (39) we may 
derive an upperbound on the limiting behavior of X2{A) or of Aiv(^), depending if X2{A) < \Xn{A)\ 
or A2(^) > |AAr(A)| in the limit. We consider each of these two cases separately. 

1) liminf;v^oo A2(A) < liminfjv-»oo |AAr(^)| : liminfjv^oo |Aiv(^)| > 2^/k^^^. 
Since Ajv(^) < 0, it follows that for /c-regular coimected simple graphs 

liminf Ajv(y4) < -2Vk - 1 

AT— >oo 

From this, we have 



liminf AAr(L) > k + 2Vk - 1 (41) 

AT— >oo 

Combining (41) with (40), we get using standard results from limits of series of real numbers 

lim inf 7(iV) = lim inf < ^ - 2./k^ 

AT^oo " AT^oo AAr(L) k + 2^{k - 1) 

Eqn (42) is an asymptotic upper bound on the spectral eigenratio parameter 7 = A2 {L) / Ajv (L) for 
the family of non-bipartite graphs for which lim inf A2(^) < lim inf |AAr(>l)|. 



2) liminfjv_»oo A2(A) > liminfjv-voo |AAr(^)| : liminfiv-^00 |AAr(^)| < 2^/k^^. 

Now Theorem (2) is inconclusive with respect to liminfjv-^oo AAr(^). From the fact that — A; < 
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^n{A) < 0, we can promptly deduce that k < Aiv(I') < 2k. Combining this with (40), we get 

. X2{L) k-2Vk^ 
k^™^ X fr\ - T. (4^) 

which gives an asymptotic upper bound for the eigenratio parameter 7 = \2{L)/\]\i{L) for the 
family of non-bipartite graphs satisfying liminf A2(^) > liminf |AAr(^)|. 
We now consider the class of Ramanujan graphs. 

Definition 3 (Ramanujan Graphs) A graph G = GN,k will be called Ramanujan if 

\g{A) < 2Vk^ (44) 

Graphs with small Xg{A) (often called graphs with large spectral gap in the literature) are called expander 
graphs, and the Ramanujan graphs are one of the best explicit expanders known. Note that Theorem 2 

and (39) show that, for general graphs, Ag'(^) is in the limit lower bounded by 2^/k^^, while for 
Ramanujan graphs Ag(A) is, for every finite N, upper bounded by 2^Jk — 1. 
From (44), it follows that, for non-bipartite Ramanujan graphs, 

A2(^) < 2\/fc^ (45) 
\n{A) > -2\fk^ (46) 

Equations (45) and (46) together with eqn (6) give, for non-bipartite Ramanujan graphs, 

M{L) > k-2V'k^ 
Xn{L) < k + 2Vk-l 

and, hence, for non-bipartite Ramanujan graphs 

HLl^k^2Vk^ (47) 
Ajv(L) - k + 2y/k^ 

This is a key result and shows that for non-bipartite Ramanujan graphs the eigenratio parameter 7 is lower 
bounded by (47). It will explain in what sense we take Ramanujan graphs to be "optimal" with respect 
to the topology design problem stated in Subsection IV-A as we discussed next. To do this, we compare 
the lower bound (47) on 7 for Ramanujan graphs with the asymptotic upper bounds (42) and (43) on 7 
for generic graphs. We consider the two cases separately again. 

1) Generic graphs for which liminfjv^oo A2(^) < lim inf tv^oo I Atv (^) | • Here, the lower bound 
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on (47) and the upper bound on (42) are the same. Since for any value of N, (47) shows that 
7 is above the bound, we conclude that, in the limit of large A'^, the eigenratio parameter 7 for 
non-bipartite Ramanujan graphs approaches the bound from above. This contrasts with non-bipartite 
non-Ramanujan graphs for which in the limit of large N the eigenratio parameter 7 stays below the 
bound. 

2) Generic graphs for which lim inf jv->oo ^2 (^) > liminfjv-+oo |AAr(^)| • Now the bound (43) does 
not help in asserting that Ramanujan graphs have faster convergence than these generic graphs. This 
is because 

k - 2y/k^ k-2Vk^ 
k + 2Vk^ k 

i.e., the lower bound (47) for Ramanujan graphs is smaller than the upper bound (43) for generic 
graphs. We should note that the ratio of two quantities is usually much more sensitive to variations 
in the numerator than to variations of the denominator. Because Ramanujan graphs optimize the 
algebraic connectivity of the graph, i.e., \2{L), we still expect 7 to be much larger for Ramanujan 
graphs than for these graphs. We show in Section VI this to be true for broad classes of graphs, 
including, structured graphs, small-world graphs, and Erdds-Renyi random graphs. 

C. Ramanujan graphs: Explicit Algebraic Construction 

We now provide explicit constructions of Ramanujan graphs available in the literature. We refer 
the reader to the Appendix for the definitions of the various terms used in this section. The exphcit 
constructions presented next are based on the construction of Cay ley graphs. The following paragraph 
gives a brief overview of the Cayley graph construction. 

Cayley Graphs. The Cayley graph construction gives a simple procedure for constructing A;-regular 
graphs using group theory. Let X be a finite group with \X\ = N, and S a A;-element subset of X. For the 
graphs used in this paper, we assume that 5 is a symmetric subset of X, in the sense that s e S imphes 
G S. We now construct a graph G = G{X, S) by having the vertex set to be the elements of X, with 
(n, v) as an edge if and only if vu^^ € S. It can be easily verified that, for a symmetric subset S, the 
graph constructed above is A;-regular on |X| vertices. The subset S is often called the set of generators 
of the Cayley graph G, over the group X. Explicit constructions of Ramanujan graphs for a fixed k 
and varying N, [24], have been described for the cases A; — 1 is a prime, [22], [25], or a prime power, 
[26]. The Ramanujan graphs used in this paper are obtained using the Lubotzky-Phillips-Samak (LPS) 
construction, [22]. We describe two constructions of non-bipartite Ramanujan graphs in this section, 
[22], and refer to them as LPS-I and LPS-II, respectively. 
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LPS-I Construction. We consider two unequal primes p and q, congruent to 1 modulo 4, and further 
let the Legendre symbol =1. The LPS-I graphs are Cayley graphs over the PSL(2,Z/qZ) group 
(Projective Special Linear group over the field of integers modulo q.) (Precise definitions and explanations 
of these terms are provided in the Appendix.) Hence, in this case, the group X is the PSL(2,Z /qZ) group. 
It can be shown that the number of elements in X is given by 

see [22]. To get the symmetric subset S of generators, we consider the equation, 

al + al + al + al= p, 

where ao,ai,a2,a3 are integers. Let 

(3 = (oo,ai, 02,03), 

be a solution of the above equation. From a formula by Jacobi, [27], there are a total of 8{p + 1) 
solutions of this equation, and, out of them, p + 1 solutions are such that oq > and odd, and aj even 
for j = 1,2,3. Also, let i be an integer satisfying 

= —1 mod (g). 

For each of these p+1 solutions, /?, we define the matrix /3 in PSL(2,Z/gZ) as, 

~ / oo + iai a2 + ia^ 
\ —02 + ias ao — iai 

The Appendix shows that these p + 1 matrices belong to the 'PSh(2,Z / qZ) group. These p + 1 matrices 
constitute the subset S, and S acts on the 'PSh(2,Z/qZ) group to produce the p + 1-regular Ramanujan 
graphs on — 1) vertices. The Ramanujan graphs thus obtained are non-bipartite, see [22]. As an 

example of a LPS-I graph, we may choose p = 17 and q = 13. We note that p and q are congruent to 1 
modulo 4, and the Legendre symbol = 1. The LPS-I graph with these values of p and q will be a 
regular graph with degree k = p + 1 = 18 and has = 1092 vertices. 

The only problem with the LPS-I graphs is that the number of vertices grows as 0{q^), which hmits 
the use of such graphs. In the next section the explicit construction of a second-class of Ramanujan 
graphs is presented that avoids this difficulty. 

LPS-II Construction. The LPS-II graphs are obtained in a slightly different way. Here also, we start 




14 



n 




Fig. 1. LPS-II graph with number of vertices A'^ = 42 and degree k — 6. 

with two unequal primes p and q congruent to 1 mod 4, such that the Legendre symbol = 1. We 
define the set P^{Fq) = {0, 1, <? — 1, oo}, called Projective line over Fq, and which is basically the set 
of integers modulo q, with an additional "infinite" element inserted in it. It follows that |P^(Fq)| = q + 1. 
The LPS-II graphs are produced by the action of the set S of the p + 1 generators defined above (LPS- 
I) on P^{Fq), in a linear fractional way. More information about linear fractional transformations is 
provided in the Appendix. The Ramanujan graphs obtained in this way, are non-bipartite p + 1-regular 
graphs on g + 1 vertices [22]. The LPS-II graphs thus obtained, may few loops [28], which does not 
pose any problem because their removal does not affect the Laplacian matrix and hence its spectrum in 
any way (this is because the Laplacian L = D — A, and a loop at vertex n adds the same term to both 
Dnn and Ann, which gets canceled while taking the difference.) The LPS-II offers a larger family of 
Ramanujan graphs than LPS-I, because in the former, the number of vertices grows only linearly with 
q. As an example of a LPS-II Ramanujan graph, we take p = b and q = 41. (It can be verified that 
p,q = 1 mod (4) and the Legendre symbol, = 1.) Thus, we have a non-bipartite Ramanujan graph, 
which is 6-regular and has 42 vertices. Fig. 1 shows the graph, thus obtained. 

V. Distributed Inference 

In this Section, we apply the average-consensus algorithm to inference in sensor networks, in particular, 
to detection. This continues our work in [8], [9] where we compared small-world topologies to Erdos- 
Renyi random graphs and structured graphs. Subsection V-A formalizes the problem and Subsection V-B 
presents the noise analysis. 
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A. Distributed Detection 

We study in this Section tlie simple binary hypothesis test where the state of the environment takes 
one of two possible alternatives, Hq (target absent) or Hi (target present). The true state H is monitored 
by a network G of N sensors. These collect measurements y = (yi, . . . un) that are independent and 
identically distributed (i.i.d.) conditioned on the true state H\ their known conditional probability density 
is fi{y) = f{y\Hi), i = 0,1. We first consider a parallel architecture where the sensors communicate to 
a single fusion center their local decisions. 

Each sensor Vn, n = 1, . . . , N, starts by computing the (local) log-likelihood ratio (LLR) 

.„.^«l) (49) 

Pr(y„|i/o) 

of its measurement y„. The local decisions are then transmitted to a fusion center. The central decision 
is 

1 ^ H=l 
n=l H=0 

where v denotes an appropriate threshold derived for example from a Bayes' criteria that miiumizes the 
average probability of error Pg. 
To be specific, we consider the simple binary hypothesis problem 

Hm- yn = IJ-m + Cn, ^n^ {0,a^) , m = 0,1 (51) 

where, without loss of generality, we let fii = ~ = ^. 

Parallel architecture: fusion center Under this model, the local likelihoods are also Gaussian, i.e., 

Hm- rn^M { ^2 , I (52) 

From (50), the test statistic for the parallel architecture fusion center is also Gauss 

H^: .~^(?^,^) (53) 

The error performance of the minimum probability of error Pg Bayes' detector (threshold = in (50)) 
is given by 

- = / -j=e-"^ dx (54) 
Jd/2 V27r 
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where the equivalent signal to noise ratio £■ that characterizes the performance is given by, [29], 



d = ?^i^ (55) 

cr 

Distributed detection. We now consider a distributed solution where the sensor nodes reach a global 
common decision H about the true state H based on the measurements collected by all sensors but 
through local exchange only of information over the network G. By local exchange, we mean that the 
sensor nodes do not have the ability to route their data to parts of the network other than their immediate 
neighbors. Such algorithms are of course of practical significance when using power and complexity 
constrained sensor nodes since such sensor networks may not be able to handle the high costs associated 
with routing or flooding techniques. We apply the average-consensus algorithm described in Section HI- 
A. This distributed average-consensus detector achieves asymptotically (in the number of iterations) the 
same optimal error performance of the parallel architecture given by (54), see [8], [9]. 

Actually, we consider a more general problem than the average-consensus algorithm in (13), namely, we 
assume that the communications among sensors is through noisy channels. Let the network state, i.e., the 
hkehhood vector, at iteration z be Xj G M^. We modify (13), by taking into account the communication 
channel noise in each iteration. The distributed detection average-consensus algorithm is modeled by 

Xj+i = Wy^i -V rij (56) 

The weight matrix is as given by (17) using the weight in (18) 

W = 1- VTTT^-^^TT^ (57) 

A2(L) + Aiv(L) 

The initial condition xq that collects the local LLRs r„ given in (14), herein repeated, 

xo = [ri • • • rAr]^ 

has statistics 

Rrn-. xo~AA(^^^l,Eo = ^lj, m = 0,l (58) 

The communications noise at iteration i is zero mean Gauss white noise with covariance R given by 

Hi ~ N(SS,R) (59) 
R = diag .,</.2,] (60) 

The communication channel noise iij is assumed to be independent of the measurement noise Vi,n. 
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The final decision at each sensor is 

H{n)=l 
Xn{i) ^ V 
H(n)=0 

where H{n) denotes the decision of sensor Vn. 
B. Noise Analysis 

In this Subsection we carry out the statistical analysis of the distributed average-consensus detector. 

Theorem 4 The local state a;„(i) has mean 

H^: E[xn{i)] = '^-^ (61) 

where E\^\ stands for the expectation operator and /x^ is either = /x or /xq = — /x. 
Proof: From the distributed detection (56) 



N 

^n(O=E(^0„,,-^i (62) 



Hence, 

E{xn{^] = ^-^j:{wX, (63) 

It follows: 

N 

= ln,l 



= 1 (64) 

(since 1 is an eigenvector of W with eigenvalue 1, it is also an eigenvector of with eigenvalue 1.) 
Replacing this result in (63) leads to the Theorem and (61). ■ 
We now consider the variance var„(i) of the state Xn{i) of the sensor n at iteration i. The following 
Theorem provides an upper bound. 

Theorem 5 The variance var„ (i) of the state x„ (i) of the sensor n at iteration i is bounded by 



4/7,2 

var„(z) < — 2" 



1 2^ 1 



^max 



i , 1-72" L 1 
LiV+l-7|V 



(65) 



where 72 is given in (35). 
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Proof: Let the covariance of the network state at iteration i be 

Ej = covar{xj} 

From eqn. (56) and using standard stochastic processes analysis 

i-l 



Si = W'T^qW' + ^ W^RW^ (66) 



fe=0 

Thus the variance at the n-th sensor is given by, 

i-l 



var„(i) = {W'T^oW')^^^ + ^ {w'^RW^)^^ (67) 



fe=0 

Let w^"'' be the columns of W, j G [1, iV]. Then, 

N 



W'^RW^ = <t>]^T^f^^ (68) 



It follows 

N 



(k) (k) 

where Wj ^ represents the n-th component of the vector . Denote by 

0max = max (^1, ...,(f)N) 

From eqn. (69), we get 

.7 = 1 

(w'^'') (70) 

V / n.n 



''max 



We now use the eigendecomposition of W in (20). This leads to 

N 



W^' = (71) 



m=l 
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from which 



\ / n.n 

m=l 
1 ^ 

m=2 
1 ^ 



m=2 



± + I 1 _ ^ 



Hence, from eqn. (70), 



\ / n.n \ / ) 



< ^max 



1 

iV 



Through a similar set of manipulations. 
Finally from eqn. (67) we obtain. 



V / n,n 



- (72 



2 r 



1 

N 



+ 7IMI 



1 

N 



An? 

var„(i) < — 2" 



(7^ 



+7IM1 



N 

- + 7iM 1 - 



1 

iV 

1 

iV 

1 



i-1 

fc=0 



max 



^ + ^2fc ( 1 _ ^ 

AT ^ '2 I AT 



+ 



E 

fc=0 '- 



62 

^max 



+ - „2 I ^ ^ 



(72) 



(73) 



(74) 



(75) 



N 1-7| 

which gives an upper bound on the variance of the n-th sensor at iteration i and proves Theorem 5. ■ 
If the channels are noiseless, we immediately obtain a Corollary to Theorem 5 that bounds the variance 
of the state of sensor n at iteration i. 



Corollary 6 With noiseless communication channels, the variance of the state of sensor n at iteration i 
is bounded by 

4//2 r 1 „. / 1 M 

(76) 



var„(z) < — 

(7^ 



N \ N 
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We now interpret Theorems 4 and 5, and Corollary 6. Theorem 4 shows that the mean of the local state 
is the same as the mean of the global statistic I of the fusion center in the parallel architecture. Then 
to compare the local probability of error P(.{i,n) at sensor n and iteration i in the distributed detector 
with the probability of error of the fusion center in the parallel architecture we need to compare the 
variances of the sufficient statistics in each detector. With noiseless communication channels, we see that 
the upper bound in (76) in Corollary 6 converges to We now interpret Theorems 4 and 5, and Corollary 6. 
Theorem 4 shows that the mean of the local state is the same as the mean of the global statistic £ of 
the fusion center in the parallel architecture. Then to compare the local probabihty of error Pe{i,n) at 
sensor n and iteration i in the distributed detector with the probabihty of error Pg of the fusion center 
in the parallel architecture we need to compare the variances of the sufficient statistics in each detector. 
With noiseless communication channels, we see that the upper bound in (76) in Corollary 6 converges 
to 



1 .2^ (- 1 



which is the variance of the parallel architecture test statistic (50). This shows that 

lim Pe(«,ri) = Pe (77) 

i— >oo 

The rate of convergence is again controlled by 



if = [ 1 



\2{L) + \n{L)) 

and maximizing this rate is equivalent to minimizing 72, which in turn, see (35), is equivalent to 
maximizing the eigenratio parameter 7 = \2{L)/\n{L) like for the average-consensus algorithm. 

For noisy channels, it is interesting to note that there is a linear trend (j)'^^i/N that makes var„(z) to 
become arbitrarily large as the number of iterations i grows to 00. We no longer have the convergence 
of the probability of error P^{i,n) as in (77). The average minimum probability of error is still given 
by (54), with now the equivalent SNR parameter bounded below by Theorem 5. 

C. Optimal number of iterations 

With noisy communication channels, the performance of the distributed detector no longer achieves 
the performance of the fusion center in a parallel architecture. This is no surprise, since each iteration 
corrupts the inter communicated state of the sensor However, there is an interesting tradeoff between 
sensing signal to noise ratio (S-SNR) and the communication noise. Intuitively, the local sensors perceive 
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better the global state of the environment as they obtain information through their neighbors from more 
remote sensors. However, this new information is counter balanced by the additional noise introduced by 

the communication links. This leads to an interesting tradeoff that we now exploit and leads to an optimal 
number of iterations to carry out the consensus through noisy channels before a decision is declared by 
each sensor. 

The upper bound in eqn. (75) is a function of the number of iterations i. We rewrite it, replacing the 
integer valued iteration number ihy a continuous variable z, as 

^^'^"i^^ i-7i r\ n)[-^-i^J'^ ^''^ 



We consider only the case when 



> 1-7| 



This is reasonable. For example, if ^ > (/>^ax' which is the case when the communication noise is 
smaller than the equivalent sensing noise power and iterating among sensors can be reasonably expected 
to improve upon decisions based solely on the local measurement. Secondly, if 72, which is bounded 
above by 1, is small, then the right-hand-side of (79) is more hkely to be satisfied. This means that 
topologies hke the Ramanujan graphs where 72 is minimized (which, from (35) means that the eigenratio 
parameter 7 is maximized) will satisfy better this assumption. 
We now state the result on the number of iterations. 

Theorem 7 If (79) holds, f{z) has a global minimum at 

1 



In I ^ ^^SlSi^ I (80) 



21n72 ^21n;i)(iV-l)(|^-|^) 



Proof: When (79) holds, /(z) is convex. Hence there exists a global minimum, say attained at z*. 
We find z* by rooting the first derivative, successively obtaining 

#(z*) = (21n72)fl-i-V^--^')7i'*+% = (81) 



dz^ ' ' V N) \ a'^ l-llj N 

'/'max 

(iV-l)(21n72) (¥-#t) 



„,2z* '/'max /'oo\ 

72 = (82) 



^max 



z* = - In I '^■""'^ I (83) 
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From Theorem 7, we conclude that, if z* > 0, then the variance upper bound will decrease till i* = lz*\ . 
The iterative distributed detection algorithm should be continued till i* if 

min (f{[z*\) ,filz*])) < var„(0) = ^ (84) 

Numerical Examples. We illustrate Theorem 7 with two numerical examples. We consider a network 
of N = 1,000 sensors, /x^/a^ = 1 (0 db), and 72 = .7. The initial Ukehhood variance before fusion is 
var„(0) = 4. We first consider (^^ax = -1 Then, z* = 17.6 and var„(17) <filz*\) = .0238 =f{\z*]). 
The variance reduction achieved with iterative distributed detection over the single measurement decision 
is v^"(°«'*) > 168 = 22 dB, a considerable improvement. We now consider a second case where the 
communication noise is (jjmax = -3162. It follows that z* = 14.3, and the improvement by iterating till 
i* = 14 with the distributed detection is > 20 = 13 dB. 

VI. Experimental Results 

This section shows how Ramanujan graph topologies outperform other topologies. We first describe 
the graph topologies to be contrasted with the Ramanujan LPS-II constructions described in Section IV. 
We start by defining the average degree k^„g of a graph G as 

2\E\ 



where |£^| = M denotes the number of edges and |F| = N is the number of vertices of the graph. In 
this section, we use the symbols and terms k and k^yg interchangeably. For, /c-regular graphs, it follows 
that /cavg = k. This means, that, when we work with general graphs, k refers to the average degree, while 
with regular graphs, it refers to both the average degree and the degree of each vertex. 

A. Structured graphs, Watts-Strogatz Graphs, and Erdos-Renyi Graphs 

We compare Ramanujan graphs, which are regular graphs, with regular and non regular graphs. The 
symbol k will stand in this Section for the degree of the graph for regular graphs and for the average 
degree for non regular graphs. We describe briefly the three classes of graphs used to benchmark the 
Ramanujan graphs. Structured graphs usually have high clustering but large average path length. Erdos- 
Renyi graphs are random graphs, they have small average path length but low clustering. Small-world 
graphs generated with a rewiring probability above a phase transition threshold have both high clustering 
and small average path length. 

Structured graphs: Regular ring lattice (RRL. This is a highly structured network. The nodes are 
numbered sequentially (for simphcity, display them uniformly placed on a ring.) Starting from node # 1, 
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connect each node to k/2 nodes to the left and k/2 nodes to the right. The resulting graph is regular 
with degree k. 

Small world networks: Watts-Strogatz (WS-I). We explain briefly the Watts-Strogatz construction 
of a small world network, [15]. It starts from a highly structured regular network where the nodes are 
placed uniformly around a circle, with each node connected to its k nearest neighbors. Then, random 
rewiring is conducted on all graph hnks. With probability Pw, a link is rewired to a different node chosen 
uniformly at random. Notice that the Pw parameter controls the "randomness" of the graph in the sense 
that Pw = corresponds to the original highly structured network while pyj = 1 results in a random 
network. Self and parallel links are prevented in the rewiring procedure and the number of links is kept 
constant, regardless of the value of p^^. In [8], distributed detection was studied with two slightly different 
versions of the Watts-Strogatz model. In both versions, the rewiring procedure is such that the nodes 
are considered one by one in a fixed direction along the circle (clockwise or counter clockwise.) For 
each node, the k/2 edges connecting it to the following nodes (in the same direction) are rewired with 
probabihty pw In the first version of the Watts-Strogatz model, called Watts-Strogatz-I (WS-I) in the 
sequel, the edges are kept connected to the current node while their other ends are rewired with probability 
Pyj. In the second version, called Watts-Strogatz-II (WS-II), the particular vertex to be disconnected is 
chosen randomly between the two ends of the rewired edges. It was shown in [8] that the WS-I graphs 
yield better convergence rates among the different models of small world graphs considered in that paper 
(WS-I, WS-II, and the Kleinberg model, [16], [17].) Hence, we restrict attention here to WS-I graphs. 

Erdos-Renyi random graphs (ER). In these graphs, we randomly choose ^ edges out of a total 
of possible edges. These are not regular graphs, their degree distribution follows a binomial 

distribution, which in the limit of large approaches the Poisson law. 

B. Comparison Studies 

We present numerical studies that will show the superiority of the Ramanujan graphs (RG) over the 
other three classes of graphs: Regular ring lattice (RRL), Watts-Strogatz-I (WS-I), and Erdos-Renyi (ER) 
graphs. We carry out three types of comparisons: (1) Convergence speed (2) The 7 parameters for the 
RG and each of the other three classes of graphs; (3) The algebraic connectivity X2{L) for the RG and 
each of the other three classes of graphs. In Section V, we considered a distributed detection problem 
based on the average-consensus algorithm. Here we present results for the noiseless link case. We define 
the convergence time Tc of the distributed detector, as the number of iterations required to reach within 
10% of the global probabihty of error, averaged over all sensor nodes. Rather than using Tc, the results 
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are presented in terms of the convergence speed, Sc = 1/Tc. To simplify the comparisons, we subscript 
the 7 parameter by the corresponding acronym, e.g., 7rg to represent the eigenratio of the Ramanujan 
graph. We also define the following comparison parameters 

^(RRL) = uiRRL) = and ,(RRL) = (85) 

Jc, RRL 7RRL M,RRL[J^) 

Ramanujan graphs and regular ring lattices. Fig. 2 compares RG with RRL graphs. The panel 
on the right plots 'i/'(RRL)> the center panel displays i/(RRL), and the right panel shows ry(RRL) when 




Fig. 2. Spectral properties of LPS-II and RRL graphs, k — 18, varying A'^: Left: Ratio of convergence speed -(/"(RRL); Center: 
Ratio !/(RRL) of Right: Ratio ry(RRL) of \2{L). 



the degree k = 18 and the number of nodes N varies. We conclude that the RGs converge 3 orders of 
magnitude faster than the RRLs, the 7 parameters can be up to 3, 500 times faster, and the algebraic 
connectivity for the RGs can be up to 4, 000 times larger than for the RRLs. 

Ramanujan graphs and Watts-Strogatz graphs. Fig. 3 contrasts the RG with the WS-I graphs. 
Because the WS-I graphs are randomly generated, we fix the number of nodes N = 6038 and the degree 
A; = 18 and vary on the horizontal axis the rewiring probability < pw < 1- The Figure shows on the 
left panel the convergence speed Sc- The top horizontal line is Sc for the RG — it is fiat because the 
graph is the same regardless of The three lines below correspond to the WS-I topologies. For each 
value of we generate 150 WS-I graphs. Of the WS-I three lines, the top line corresponds, at each p^, 
to the topologies (among the 150 generated) with maximum convergence rate, the medium line to the 
average convergence rate (averaged over the 150 random topologies generated), and the bottom line to 
the topologies (among the 150 generated) with worst convergence rate. Similarly, the center and right 
panels on Fig. 3 compare the eigenratio parameters 7 (center panel) and the algebraic connectivity A2 
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Fig. 3. Spectral properties of LPS-II and WS-I graphs, A'^ = 6038, k — 18, varying pw Left: Sc', Center: eigenratio 7 = — 
Right: algebraic connectivity A2. 



(right panel). For example, the RG improves by 50 % the 7 eigenratio over the best WS-I topology (in 
this case for = -8.) 

Ramanujan graphs and Erdos-Renyi graphs. We conclude this section by comparing the LPS- 
II graphs with the Erdos-Renyi graphs in Figs. 4 and 4. Fig. 4 shows the results for topologies with 
different number of sensors (plotted in the horizontal axis.) For each value of N, we generated 200 
random Erdos-Renyi graphs. In the panels of both Figures, the top line illustrates the results for the 
RG, while the three lines below show the results for the Erdos-Renyi graphs — among these three, the 
top line is the topology with best convergence rate among the 200 ER topologies, the middle plot is 
the averaged convergence rate, averaged over the 200 topologies, and the bottom line corresponds to 
the worst topologies. Again, for example, the 7 parameter of the RG is about twice as large than the 7 
parameter for the ER. 

VII. Random Regular Ramanujan-Like Graphs 

Section IV-C explains the construction of the Ramanujan graphs. These graphs can be constructed only 
for certain values of A^, which may limit their application in certain practical scenarios. We describe here 
briefly biased random graphs that can be constructed with arbitrary number of nodes and average 
degree, and whose performance closely matches that of Ramanujan graphs. Reference [30] argues that, 
in general, heterogeneity in the degree distribution reduces the eigenratio 7 = j^^- Hence, we try to 
construct graphs that are regular in terms of the degree. There exist constructions of random regular 
graphs, but these are difficult to implement especially for very large number of vertices, see, e.g., [31], 
[32], [33], [34], which are good references on the construction and application of random regular graphs. 
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Fig. 4. Spectral properties of LPS-II and ER graphs, k = 18, varying A'': Left: Convergence speed Sc', Center: eigenratio 
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Ours is a procedure that is simple to implement and constructs random regular graphs, which we refer 
to as Random Regular Ramanujan-Like (R3L) graphs. Suppose, we want to construct a random regular 
graph with N vertices and degree k. Our construction starts from a regular graph of degree k, which we 
call the seed. The seed can be any regular graph of degree k, for example, the regular ring lattice with 
degree k (see Section VI.) We start by randomly choosing (uniformly) a vertex (call it vi.) In the next 
step, we randomly choose a neighbor of vi (call it V2), and we also randomly choose a vertex not adjacent 
to vi (call it t>3.) We now choose a neighbor of ^3 (call it ^4). The next step consists of removing the 
edges between vi and V2, and between V3 and V4. Finally we add edges between vi and and between 
V2 and U4. (Care is taken so that no conflict arises in the process of removing and forming the edges.) It 
is quite clear that after this sequence of steps, the degree of each vertex remains the same and hence the 
resulting graph remains A; -regular. We repeat this sequence of steps a sufficiently large number of times, 
which makes the resulting graph to become random. Thus, staring with any /c -regular graph, we get a 
random regular graph with degree k. 

We now present numerical studies of the R3L graphs, which show that these graphs have convergence 
properties that are very close to those of LPS-II graphs. Specifically, we focus on the eigenratio parameter 



Fig. 5 plots the eigenratio 7 = for the RG and the R3L graphs for varying number of nodes 

and degree k = 18. We generate 100 R3L graphs for each value of N. The top three lines correspond to 
the RG, the best R3L topologies, and the average value of 7 over the 100 R3L graphs. We observe that 
the maximum values of 7 = jjj^ are sometimes higher than those obtained with the LPS-II graphs. 
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'1000 1500 2000 2500 3000 
Fig. 5. LPS-II and R3L graphs, k — 18, varying TV: Eigenratio 7 = -jj^^- 

Note also that, on average, the R3L graphs are quite close to the LPS-II graphs in terms of the 7 = 
ratio, even for large values of A^. This study shows that the R3L graphs are a good alternative to the 
LPS-II graphs with the added advantage that they can be generated for arbitrary number of nodes N and 
degree k. 

VIII. Conclusion 

The paper studies the impact of network topology on the convergence speed of distributed inference 
and average-consensus. We derive that the convergence speed is governed by a graph spectral param- 
eter, the eigenratio 7 = X2{L) / \n{L) of the second largest and the largest eigenvalues of the graph 
Laplacian. We show that the class of non-bipartite Ramanujan graphs is essentially optimal. Numerical 
simulations verify the Ramanujan LPS-II graphs outperform the highly structured graphs, the Erdos-Renyi 
random graphs, and graphs exhibiting the small-world property. We considered average-consensus and 
distributed detection with noiseless and noisy links. We derived for the distributed inference problem an 
analytical upper bound on the likelihood variance. For noiseless links, this bound shows that the local 
likelihood variances (and hence the local probability of errors) converge to the global likelihood variance 
(global probability of error) at a rate determined by 7. With noisy links, we demonstrate that there is 
a maximum, optimal number of iterations before declaring a decision. Finally, we introduced a novel 
biased construction of random regular graphs (R3L graphs) and showed by numerical results that their 
convergence performance tracks very closely that of the Ramanujan LPS-II graphs. R3L graphs address a 
main limitation of Ramanujan graphs that can be constructed only for very restricted number of nodes. In 
contrast, R3L graphs are simple to construct and can have an arbitrary number of nodes and degree k. 
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Appendix 



Definition 8 (Group) : A group X is a non-empty collection of elements, with a binary operation "." 
defined on them, such that the following properties are satisfied: 

1) If a, 6 e X, then a.b G X (closure property.) 

2) If a, 6, c G X, then a.{b.c) = {a.b).c (associative property.) 

3) There exists an element e e X, such that for any element a e X, a.e = e.a = a (identity element.) 

4) Va G X, there exists G X, the inverse of a, such that a.a~^ = a~^.a = e (inverse.) 

The group X is called abehan if the "." operation is commutative, that is, for any a, 6 G X, a.b = b.a. 

Definition 9 (Field) : A field F is a non-empty collection of elements, with the following properties: 
There exists a binary operation "+" on the elements of F such that, 

1) If a, 6 G F, then a + beF. 

2) If a, 6 G F, then a + b = b + a. 

3) If a,b,c£ F, then a + (b + c) = [a + b) + c. 

4) There exists an element (zero) G F, such that for any element a € F, a + = a. 

5) If a G F, then there exists an element (— o) G F, such that a + (—a) = (—a) + a = 0. 
There exists another binary operation "." on the elements of F such that, 

1) If a, 6 G F, then a.b G F. 

2) If a, 6 G F, then a.b = b.a. 

3) If a, 6, c G F, then a.{b.c) = {a.b).c. 

4) There exists a non-zero element 1 (one) G F, such that for any element a e F, a.l = a. 

5) For every non-zero element a e F, there exists an element G F, such that a.a~^ = 1. 

6) If a, 5, c G F, then a.{b + c) = a. 6 + a.c. 

Congruence. For integers a, b, c, the statement a is congruent to b modulo c, or a = 6 mod (c) impUes 
that (a — b) is divisible by c. 

Quadratic Residue. For integers a, 6, the statement a is a quadratic residue modulo b impUes that there 
exists an integer c such that (? = a mod (6). 



Definition 10 (Legendre Symbol) : For an integer a and a prime p, the Legendre symbol ( f ) is 




if p divides a 




1 if a is a quadratic residue modulo p 
— 1 if a is a quadratic non-residue modulo p 



(86) 
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PSL(2,Z/qZ). For a prime q, the set Z/qZ = {0, 1, ..,q — 1} is the field of integers modulo q. To 
define the group PSL(2, Z/qZ) (Projective Special Linear Group), first consider the set of 2 x 2 matrices 
over the field Z/qZ, whose determinants are non-zero quadratic residues modulo q. Next, define an 
equivalence relation on this set, such that two matrices are in the same equivalence class, if one is a 
non-zero scalar multiple of the other The FSL(2, Z/qZ) group is then the set of all these equivalence 
classes. Think of each element of PSL(2, Z/qZ) as a 2 x 2 matrix over the field Z/qZ, whose determinant 
is a non-zero quadratic residue modulo q, and whose second row can be represented as either (0,1) or 
(l,a), where a being any element of Z/qZ, [35]. The p + 1 generators discussed in the paper, belong to 
the 'PS'L(2,Z / qZ) group, because their determinants are p mod {q) and by assumption, p is a quadratic 
residue modulo q or ( ^ ) = 1 for the non-bipartite Ramanujan graphs we use in this paper. 



. a b . 

Linear Fractional Transformation. Let P {Fq) = {0, 1, q' — 1, oo} and | | be a 2 x 2 matrix. 

c (' 

Then a linear fractional transformation on P^{Fq) is defined by the mapping, 

X I — > ^ mod {q) (87) 

cx + a 

for every element x G P^{Fq), with the usual assumptions that g = cxd for z 7^ 0, and = |. 

Definition 11 (Bipartite graph) : A bipartite graph is a graph in which the vertex set can be partitioned 
into two disjoint subsets, such that no two vertices in the same subset are adjacent. 
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